Best Large Model Inference Engine AI Tools & Models - Premium Large Model Inference Engine News

AI News

Xiaomi's self-developed large model MiMo has gained international recognition for its practical capabilities

According to the latest statistics from the AI platform OpenRouter, the open-source Agent framework Hermes Agent has topped the global usage volume, with a daily average token usage of 291 billion and a weekly usage exceeding 1.75 trillion. Xiaomi's self-developed MiMo large model has been the preferred inference engine, contributing 1.45 trillion token usages in the past month, ranking first among all supporting models and becoming a core driving force.

15.7k 7 hours ago

New Breakthrough in Domestic GPU: Moortech S5000 Supports China Mobile's Jiutian Large Model

At the 9th Digital China Construction Summit, China Mobile will publicly showcase its self-developed "Jiutian" 35B general large model for the first time. Moortech announced that its flagship GPU MTTS 5000 has completed full-process adaptation and inference verification for this model, marking an important breakthrough in the domestic computing power ecosystem. Through its self-developed MUSA software stack and the high-performance inference engine SGLang-MUSA, Moortech has achieved deep integration and optimization throughout the entire inference pipeline of the "Jiutian" 35B model.

11.2k 18 hours ago

New Breakthrough in Domestic GPU: Moortech S5000 Supports China Mobile's Jiutian Large Model

The Birth of an 800 Million Dollar Computing Power 'Nuclear Bomb': The Original vLLM Team Launches Inferact Aimed at the Global AI Inference Throne

As AI giants focus on large models, a computing efficiency revolution is quietly underway. The top open-source inference engine vLLM team has founded Inferact, an AI infrastructure company aiming to establish a new order in AI inference. This marks not only a technological leap but also a crucial step toward AI's practical application, drawing significant attention from capital markets.....

14.7k 7 hours ago

The Birth of an 800 Million Dollar Computing Power 'Nuclear Bomb': The Original vLLM Team Launches Inferact Aimed at the Global AI Inference Throne

The Domestic Computing Power Group Unites: The 10,000-Card Inference Engine and OpenSource Model Announced on the Same Day

The 2025 Guangming Science City Forum was held in Shenzhen, focusing on intelligent computing power and large model agents. Institutions such as the Shenzhen Institute of Advanced Technology announced four important achievements: the open-source multimodal model Pengcheng Haiwen 2.1 along with its corresponding dataset and toolchain; the domestic 10,000-card inference engine FenixCOS made its debut, supporting large-scale parallelism and efficient switching; the meteorological intelligent agent "Afu" was integrated into Pengcheng CloudBrain III, providing services for the 15th National Games.

11.4k 5 hours ago

AI Products

PowerInfer

High-speed large language model local deployment inference engine

AI model

16k

Models

Gemini 2.0 Flash-Lite

Google

$0.49

Input tokens/M

$2.1

Output tokens/M

Context Length

Grok 4 Fast

Xai

$1.4

Input tokens/M

$3.5

Output tokens/M

Context Length

o3-mini

Openai

$7.7

Input tokens/M

$30.8

Output tokens/M

200

Context Length

GPT-5 Codex

Openai

Input tokens/M

Output tokens/M

Context Length

Claude 3 Opus

Anthropic

$105

Input tokens/M

$525

Output tokens/M

200

Context Length

Gemini 2.0 Flash

Google

$0.7

Input tokens/M

$2.8

Output tokens/M

Context Length

Claude Haiku 4.5

Anthropic

Input tokens/M

$35

Output tokens/M

200

Context Length

Gemini 2.5 Flash

Google

$2.1

Input tokens/M

$17.5

Output tokens/M

Context Length

Claude 3 Sonnet

Anthropic

$21

Input tokens/M

$105

Output tokens/M

200

Context Length

Gemini 2.5 Flash-Lite

Google

$0.7

Input tokens/M

$2.8

Output tokens/M

Context Length

qwen3-coder-plus

Alibaba

Input tokens/M

$16

Output tokens/M

Context Length

Qianfan-Lightning

Baidu

Input tokens/M

Output tokens/M

128

Context Length

qwen3-max

Alibaba

Input tokens/M

$24

Output tokens/M

256

Context Length

Doubao-Seed-Translation

Bytedance

$1.2

Input tokens/M

$3.6

Output tokens/M

Context Length

Qwen3-Next-80B-A3B-Instruct

Alibaba

Input tokens/M

Output tokens/M

256

Context Length

Kimi-K2

Moonshot

Input tokens/M

$16

Output tokens/M

256

Context Length

Doubao-Seed-1.6

Bytedance

$0.8

Input tokens/M

Output tokens/M

256

Context Length

Doubao-1.5-pro-32k

Bytedance

$0.8

Input tokens/M

Output tokens/M

128

Context Length

Doubao-Seed-1.6-flash

Bytedance

$0.15

Input tokens/M

$1.5

Output tokens/M

256

Context Length

Doubao-Seedance-1.0-pro

Bytedance

Input tokens/M

Output tokens/M

Context Length

Empowering the future, your artificial intelligence solution think tank

English 简体中文繁體中文にほんご

FirendLinks:

AI Newsletters AI Tools MCP Servers AI News AIBase LLM Leaderboard AI Ranking

Business Cooperation Site Map